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We here present the complete analysis of experiments on driven Brownian motion and electric noise 
in a RC circuit, showing that thermodynamic entropy production can be related to the breaking of 
time-reversal symmetry in the statistical description of these nonequilibrium systems. The symmetry 
' breaking can be expressed in terms of dynamical entropies per unit time, one for the forward 

Q , process and the other for the time-reversed process. These entropies per unit time characterize 

dynamical randomness, i.e., temporal disorder, in time series of the nonequilibrium fluctuations. 
Their difference gives the well-known thermodynamic entropy production, which thus finds its origin 
t***~ , in the time asymmetry of dynamical randomness, alias temporal disorder, in systems driven out of 

O^J ■ equilibrium. 
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I. INTRODUCTION 



According to the second law of thermodynamics, nonequilibrium systems produce entropy in a time asymmetric 
way. This thermodynamic time asymmetry is usually expressed in terms of macroscopic concepts such as entropy. 
The lack of understanding of this time asymmetry in terms of concepts closer to the microscopic description of the 
' motion of particles has always been a difficulty. Only recently, general relationships have been discovered which allows 
us to express the thermodynamic time asymmetry at the mesoscopic level of description in terms of the probabilities 
I i ruling the molecular or thermal fluctuations in nonequilibrium systems. More specifically the entropy production rate 
in a system driven out of equilibrium can be estimated by measuring the asymmetries between the probabilities of 
finding certain time evolutions when the system is driven with forward nonequilibrium driving and those of finding 
the corresponding reversed time evolutions with a backward driving. In a recent letter experimental evidence 
has been reported that, indeed, the entropy production finds its origin in the time asymmetry of the dynamical 
randomness, alias temporal disorder, in driven Brownian motion and in the electric noise of a driven RC circuit. In 
these two experiments we record long time series, either of the position of the Brownian particle or of the fluctuating 
voltage of the RC circuits, which allow us to define the probabilities of given time evolutions, also called paths. This 
result shows that, under nonequilibrium conditions, the probabilities of the direct and time-reversed paths break the 
\Q . time-reversal symmetry and that the entropy production is given by the difference between the decay rates of these 
probabilities. These decay rates characterize the dynamical randomness of the paths (or their time reversals) so that 
the entropy production turns out to be directly related to the breaking of the time-reversal symmetry in the dynamical 
" randomness of the nonequilibrium fluctuations. 
f**«« , The purpose of the present paper is to provide a detailed report of these two experiments and of the data analysis. 
■ The dynamical randomness of the forward time series is characterized by the so-called (e, r)-entropy per unit time, 
which represents the average decay rate of the probabilities of paths sampled with a resolution e and a sampling time 
t Q. The precise definition of these quantities will be given in Sec. IIIII To each possible path in the forward time 
series, we look for the corresponding time-reversed path in the backward time series. This allows us to further obtain 
the time-reversed (e, r)-entropy per unit time. Remarkably, the difference between the backward and forward (e, r)- 
entropies per unit time gives the right positive value of the thermodynamic entropy production under nonequilibrium 
conditions. This result shows by direct data analysis that the entropy production of nonequilibrium thermodynamics 
can be explained as a time asymmetry in the temporal disorder characterized by these new quantities which are the 
(e, r)-entropies per unit time. 

These quantities were introduced in order to generalize the concept of Kolmogorov-Sinai entropy per unit time 
from dynamical systems to stochastic processes @, 0). In this regard, the relationship here described belongs to the 
same family of newly discovered large-deviation properties as the escar 
the steady-state or transient fluctuation theorems 

and the nonequilibrium work fluctuation theorem [25|, |26|, |27|, [28|, [29|. All these relationships share the common 
mathematical structure that they give an irreversible property as the difference between two decay rates of mesoscopic 




lat tney 

or microscopic properties [3fjl l3lj . These relationships are at the basis of the important advances in nonequilibrium 
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statistical mechanics during the last two decades [32]. Recently, the concept of time-reversed entropy per unit time 
was introduced [33[ and used to express the thermodynamic entropy production in terms of the difference between 
it and the standard (Kolmogorov-Sinai) entropy per unit time [13, S, [34], [35[. This relationship can be applied to 
probe the time asymmetry of time series [l|, |36| | and allows us to understand the origin of the thermodynamic time 
asymmetry. 

The paper is organized as follows. In Sec. HH we introduce the Langevin description of the experiments. In 
particular, we show that the thermodynamic entropy production arises from the breaking of the forward and time- 
reversed probability distributions over the trajectories. In Sec. IIII1 we introduce the dynamical entropies and describe 
an algorithm for their estimation using long time series. It is shown that the difference between the two dynamical 
entropies gives back the thermodynamic entropy production. The experimental results on driven Brownian motion are 
presented in Sec. IIVI where we analyze in detail the behavior of the dynamical entropies and establish the connection 
with the thermodynamic entropy production. The experimental results on electric noise in the driven RC circuit are 
given in Sec. [V] The relation to the extended fluctuation theorem [lil, [13] is discussed in Sec. IVI1 The conclusions 
are drawn in Sec. IVIII 



II. STOCHASTIC DESCRIPTION, PATH PROBABILITIES, AND ENTROPY PRODUCTION 

We consider a Brownian particle in a fixed optical trap and surrounded by a fluid moving at the speed u. In a 
viscous fluid such as water solution at room temperature and pressure, the motion of a dragged micrometric particle 
is overdamped. In this case, its Brownian motion can be modeled by the following Langevin equation [16j : 

dz 

a—=F{z)+au + t t (1) 

where a is the viscous friction coefficient, F = —d z V the force exerted by the potential V of the laser trap, au is the 
drag force of the fluid moving at speed u, and £ t a Gaussian white noise with its average and correlation function 
given by 

(6) = (2) 
(66') = 2k B TaS(t-t') (3) 

In the special case where the potential is harmonic of stiffness k, V = kz 2 /2, the stationary probability density is 
Gaussian 

/ \ / fife r / \2i /a 
Pst[z) = Y^: ex P [~ ~2 \ z ~ ut r) \ ( 4 ) 



with the relaxation time 



r R = I (5) 



and the inverse temperature /? = (k^T)^ 1 . The maximum of this Gaussian distribution is located at the distance utr 
of the minimum of the confining potential. This shift is due to dragging and corresponds to the position where there 
is a balance between the frictional and harmonic forces. 

The work W t done on the system by the moving fluid during the time interval t is given by [l5|, [l|| H3] 



W t = - [ uF{z t ,)dt' (6) 



while the heat Qt generated by dissipation is 



Qt = / [z v -«) F(z t >)dt' (7) 



We notice that the quantities ^ and ([7]) are fluctuating because of the Brownian motion of the particle. Both 
quantities are related by the change in potential energy AVt = V(z t ) — V(zq) so that 



Qt = W t - AV t 



(8) 
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TABLE I: The analogy between the Brownian particle and the electric RC circuit. For the Brownian particle, Zt is its position, 
it its velocity, £t the Langevin fluctuating force, a the viscous friction coefficient, k the harmonic strength or stiffness of the 
optical trap, and u the fluid speed. For the electric circuit, qt is the electric charge passing through the resistor during time t, 
it ~ qt the corresponding current, SVt the fluctuating electric potential of the Nyquist noise, R the resistance, C the capacitance, 
and / the mean current source. 



In a stationary state, the mean value of the dissipation rate is equal to the mean power done by the moving fluid 
since limt_ >tx) (l/t)(AT4) — 0. The thermodynamic entropy production is thus given by 



djS 
dt 



hm 



t T 



= hm 



t T 



au 



(9) 



in the stationary state. The equilibrium state is reached when the speed of the fluid is zero, u = 0, in which case the 
entropy production @ vanishes as expected. 

An equivalent system is an RC electric circuit driven out of equilibrium by a current source which imposes the 
mean current I (lq . [l7j . The current fluctuates in the circuit because of the intrinsic Nyquist thermal noise. This 
electric circuit and the dragged Brownian particle, although physically different, are known to be formally equivalent 
by the correspondence shown in Table Q] [16| . 

Our aim is to show that one can extract the heat dissipated along a fluctuating path by comparing the probability 
of this path, with the probability of the corresponding time-reversed path having also reversed the external driving, 
i.e., u — > — u for the dragged Brownian particle (respectively, I — > —I for the RC circuit). 

We use a path integral formulation. A stochastic trajectory is uniquely defined by specifying the noise history of 
the system £ t . Indeed, the solution of the stochastic equation ([1]), i.e., 



Zt 



— z + 



dt' z t > 



dt' 



F(zt>) + au + & 



(10) 



is uniquely specified if the noise history is known. Since we consider a Gaussian white noise, the probability to have 
the noise history £ t is given by 38] 



P [6] oc exp 



1 



4k B Ta 

According to Eq. ([T]), the probability of a trajectory zt starting from the fixed initial point zq is thus written as 

1 



P[z t |zo] ex exp 



Ak B Ta 



dt' 



F(z) 



(11) 



(12) 



We remark that the corresponding joint probability is obtained by multiplying the conditional probability (fT2j) with 
the stationary probability density ([U of the initial position as 



P[z t ] (x P[zt\z ]p s t(z ) 



(13) 



To extract the heat dissipated along a trajectory, we consider the probability of a given path over the probability 
to observe the reversed path having also reversed the sign of the driving u. The reversed path is thus defined by 
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zj) = Zt-t< which implies ij} = 
P+N z o] 



-it-t'- Therefore, we find that 
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(az — F(z) — auj — ( — az — F(z) + auj 



i 



Qt 



V{zo) - V{z t ) -u dt 1 F{z) 
Jo 



(14) 



which is precisely the fluctuating heat ([7]) dissipated along the random path Zt and expressed in the thermal unit 
k^T. The detailed derivation of this result is carried out in Appendix [A] The dissipation can thus be related to 
time-symmetry breaking already at the level of mesoscopic paths. We notice that the mean value of the fluctuating 
quantity (jT4j) behaves as described by Eq. ([9]) so that the heat dissipation rate vanishes on average at equilibrium 
and is positive otherwise. Relations similar to Eq. (|14[) are known for Boltzmann's entropy production [l3j . for 
time-dependent systems [2(], [25|, [29| , and in the the context of Onsager-Machlup theory [2l[ . We emphasize that the 
reversal of u is essential to get the dissipated heat from the way the path probabilities P+ and P_ differ. 

The main difference between these path probabilities comes from the shift between the mean values of the fluctua- 
tions under forward or backward driving. Indeed, the average position is equal to (z) + = utr under forward driving 
at speed +u, and = — utr under backward driving at speed —u. The shift 2utr in the average positions implies 
that a typical path of the forward time series falls, after its time reversal, in the tail of the probability distribution 
P_ of the backward time series. Therefore, the probabilities P_ of the time-reversed forward paths in the backward 
time series are typically lower than the probabilities P+ of the corresponding forward paths. The above derivation 
(fT4")l shows that the dissipation can be obtained in terms of their ratio P + /P_. We emphasize that this derivation 
holds for anharmonic potentials as well as harmonic ones, so that the result is general in this respect. 

In the stationary state, the mean entropy production ([9]) is given by averaging the dissipated heat (fl"4|) over all 
possible trajectories: 



djS 
~dt 



lim^/ln P+[ZtN 

t— >oo t 



P-[*f\4] 



lim fcB/ ln ^N 

t^oo t \ P-[z t R ] 

lim ^L fvz t P + [z t ] In^M 

t^oo t J +l 1 P-[zf\ 



> 



(15) 



The second equality in Eq. I|15p results from the fact that the terms at the boundaries of the time interval t are 
vanishing for the statistical average in the long-time limit. Equation (|15[) relates the thermodynamic dissipation to 
a so-called Kullback-Leibler distance [3!| or relative entropy [13] between the forward process and its time reversal. 
Such a connection between dissipation and relative entropy has also been described elsewhere [HI [ID, H3] ■ Since the 
relative entropy is known to be always non negative, the mean entropy production (|15p satisfies the second law of 
thermodynamics, as it should. Accordingly, the mean entropy production vanishes at equilibrium because of Eq. ([9]) 
or, equivalently, as the consequence of detailed balance which holds at equilibrium when the speed u is zero (see 
Appendix [3} . 

We point out that the heat dissipated along an individual path given by Eq. (| 14|) is a fluctuating quantity and may be 
either positive or negative. We here face the paradox raised by Maxwell that the dissipation is non-negative on average 
but has an undetermined sign at the level of the individual stochastic paths. The second law of thermodynamics holds 
for entropy production defined after statistical averaging with the probability distribution. We remain with fluctuating 
mechanical quantities at the level of individual mesoscopic paths or microscopic trajectories. 



III. DYNAMICAL RANDOMNESS AND THERMODYNAMIC ENTROPY PRODUCTION 



The aim of this section is to present a method to characterize the property of dynamical randomness in the time series 
and to show how this property is related to the thermodynamic entropy production when the paths are compared with 
their time reversals. In this way, we obtain a theoretical prediction on the relationship between dynamical randomness 
and thermodynamic entropy production. 
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A. (e, r)-entropies per unit time 



Dynamical randomness is the fundamental property of temporal disorder in the time series. The temporal disorder 
can be characterized by an entropy as well as for the other kinds of disorder. In the case of temporal disorder, we have 
an entropy per unit time, which is the rate of production of information by the random process, i.e., the minimum 
number of bits (digits or nats) required to record the time series during one time unit. For random processes which are 
continuous in time and in their variable, the trajectories should be sampled with a resolution e and with a sampling 
time r. Therefore, the entropy per unit time depends a priori on each one of them and we talk about the (e, r)-entropy 
per unit time. Such a quantity has been introduced by Shannon as the rate of generating information by continuous 
sources [4~i| . The theory of this quantity was developed under the names of e-entropy [42| and rate distortion function 
[43|]. More recently, the problem of characterizing dynamical randomness has reappeared in the study of chaotic 
dynamical systems. A numerical algorithm was proposed by Grassberger, Procaccia and coworkers [3, EH in order to 
estimate the Kolmogorov-Sinai entropy per unit time. Thereafter, it was shown that the same algorithm also applies 
to stochastic processes, allowing us to compare the property of dynamical randomness of different random processes 
[3, EH . Moreover, these dynamic entropies were measured for Brownian motion at equilibrium [47l EH . We here 
present the extension of this method to out-of-equilibrium fluctuating systems. 

Since we are interested in the probability of a given succession of states obtained by sampling the signal Z(t) at 
small time intervals r, a multi-time random variable is defined according to Z = [Z(to), Z(to +t), . . . , Z(to -\-rvr — r)], 
which represents the signal during the time period t — to = nr. For a stationary process, the probability distribution 
does not depend on the initial time to- From the point of view of probability theory, the process is defined by the 
n-time joint probabilities 

P s (z;dz,T,n) = Pr{z< Z < z+dz;s} = p s (z) dz (16) 

where p s (z) denotes the probability density for Z to take the values z = (zo, z\, . . . , z n ~i) at times to + ir (i = 
0, 1, 2, n— 1) for some nonequilibrium driving s = u/\u\ = ±1. Now, due to the continuous nature in time and in 
space of the process, we will consider the probability P + (Z m ; e, r, n) for the trajectory to remain within a distance e 
of some reference trajectory Z m , made of n successive positions of the Brownian particle observed at time intervals r 
during the forward process. This reference trajectory belongs to an ensemble of M reference trajectories {Z m }f/ l=1 , 
allowing us to take statistical averages. These reference trajectories define the patterns, i.e., the recurrences of which 
are searched for in the time series. 

On the other hand, we can introduce the quantity P~(Zf n ; e, r, n) which is the probability for a reversed trajectory 
of the reversed process to remain within a distance e of the reference trajectory Z m (of the forward process) for n 
successive positions. 

Suppose we have two realizations over a very long time interval Lt ^> nr given by the time series {z±(kr)}^ =1 , 
respectively for the forward (+) and backward (— ) processes. Within these long time series, sequences of length n 
are compared with each other. We thus consider an ensemble set of 1 <C M <C L reference sequences, which are all of 
length n: 

Z m = [Z(mr), ■ ■ ■ , Z{vht + nr — r)], m g {mi, • ■ • , m M } (17) 

These reference sequences are taken at equal time intervals in order to sample the forward process according to its 
probability distribution P + . The distance between a reference sequence and another sequence of length n is defined 
by 

dist„(Z m , Zj) = max{\Z(mr) - Z(jr)\, • ■ ■ , \Z{mr + nr- t) - Z(jr + nr- r)|} (18) 
for j = 1,2, L' — L — n + 1. The probability for this distance to be smaller than e is then evaluated by 

P+(Z m ; e, r,n) = — Number^- : dist„(Z m , Zj) < e} (19) 

The average of the logarithm of these probabilities over the different reference sequences gives the block entropy 

M 

M 



H{e,T,n) = -±-Y,\nP+(Z m ;e,T,n) (20) 



m— 1 



also called the mean pattern entropy. The (e, r)-entropy per unit time is then defined as the rate of the linear growth 
of the block entropy as the length n of the reference sequences increases @, HH, |45[ : 



h(e,r) = lim lim — H[e, r, n+ 1) — H{e, r, n) 

n— >oo L',M— >oo T 



(21) 
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Similarly, the probability of a reversed trajectory in the reversed process can be evaluated by 

P-{Z*-e,T,n) = 1 Numbcr{Z, : dist„(Z«„, %) < e} (22) 

where Zf n — \Z(rrvr + nr — r), • • ■ , Z(mr)] is the time reversal of the reference path Z m of the forward process, while 
{Zj}j =1 are the paths of the reversed process (with the opposite driving — u). In similitude with Eqs. (|2U)) and (l2"Tj) . 
we may introduce the time-reversed block entropy: 



1 M 

i^ R (e,r,, ^ ) In P_ (Z R ; e, r, n) (23) 



m— 1 



and the time-reversed (e, T)-entropy per unit time: 

h R (e, t) = lim lim - \h r (s, t, n + 1) - ff R (e, r, n)l (24) 

n— >oo £',M— >oo T L 

We notice that the dynamical entropy (f2"Tj) gives the decay rate of the probabilities to find paths within a distance 
e from a typical path Z = (Zq, Z\, Z%, Z n -\) with Zi = Z(to + it): 

P + (Z- 1 e,T 7 n) ~ exp[— nr/i(£,r)] (n — > oo) (25) 

as the number n of time intervals increases. In the case of ergodic random processes, this property is known as 
the Shannon-McMillan-Breiman theorem (49j |. The decay rate h characterizes the temporal disorder, i.e., dynamical 
randomness, in both deterministic dynamical systems and stochastic processes @, H, S3, EE 13 ■ On the other hand, 
the time-reversed dynamical entropy (|24p is the decay rate of the probabilities of the time-reversed paths in the 
reversed process: 

P-(Z R ;e,T,n) ~ exp[-nr/i R (e, r)] (n -> oo) (26) 

Since h R is the decay rate of the probability to find, in the backward process, the time-reversed path corresponding to 
some typical path of the forward process, the exponential exp(— h^ At) evaluates the amount of time-reversed paths 
among the typical paths (of duration At). The time-reversed entropy per unit time /i R thus characterizes the rareness 
of the time-reversed paths in the forward process. 

The dynamical randomness of the stochastic process ruled by the Langevin equation (fTJ) can be characterized in 
terms of its (e, r)-entropy per unit time. This latter is calculated for the case of a harmonic potential in Appendix IBl 
For small values of the spatial resolution e, we find that 



He, t) = i In sj (1 - e-*7«0 + 0(e 2 ) (27) 
with the diffusion coefficient of the Brownian particle: 

D = (28) 
a 

The (e, r)-entropy per unit time increases as the resolution e decreases, meaning that randomness is found on smaller 
and smaller scales in typical trajectories of the Brownian particle. After having obtained the main features of the 
(e, r)-entropy per unit time, we go on in the next subsection by comparing it with the time-reversed (e, r)-entropy 
per unit time, establishing the connection with thermodynamics. 



B. Thermodynamic entropy production 

Under nonequilibrium conditions, detailed balance does not hold so that the probabilities of the paths and their 
time reversals are different. Similarly, the decay rates h and h R also differ. Their difference can be calculated by 
evaluating the path integral ()15|) by discretizing the paths with the sampling time r and resolution e 



diS - Urn /"-"- u r. i i- P+[*t] 



J Vz t P+[z t ] In- 



dt t^oo t J +L J P_[z\ 



M 



lim lim lim lim ^ V In P +^ £ ^ (29) 
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The statistical average is carried out over M paths of the forward process and thus corresponds to the average with 
the probability P + [z t }. The logarithm of the ratio of probabilities can be splitted into the difference between the 
logarithms of the probabilities, leading to the difference of the block entropies (f23|) and (|20jl . The limit n — ► oo of the 
block entropies divided by n can be evaluated from the differences between the block entropy at n + 1 and the one 
at n, whereupon the (e, r)-entropies per unit time (|21|) and (|24[) appear. Finally, the mean entropy production in the 
nonequilibrium steady state is given by the difference between the time-reversed and direct (e, r)-entropies per unit 
time: 



— ^— = lim lim fee 

at e^O t^O 



h R {e,T) -h(e,r) (30) 



The difference between h R and h characterizes the time asymmetry of the ensemble of typical paths effectively 
realized during the forward process. Equation (|30[) shows that this time asymmetry is related to the thermodynamic 
entropy production. The entropy production is thus expressed as the difference of two usually very large quantities 
which increase for e going to zero 0, E|| . Out of equilibrium, their difference remains finite and gives the entropy 
production. At equilibrium, the time-reserval symmetry /i R = h is restored so that their difference vanishes with the 
entropy production. In the next two sections, the theoretical prediction (|30|) is tested experimentally. 



IV. DRIVEN BROWNIAN MOTION 



The first experimental system we have investigated is a Brownian particle trapped by an optical tweezer, which 
is composed by a large numerical aperture microscope objective (x63, 1.3) and by an infrared laser beam with a 
wavelength of 980 nm and a power of 20 mW on the focal plane. The trapped polystyrene particle has a diameter of 
2 /zm and is suspended in a 20% glycerol- water solution. The particle is trapped at 20 /im from the bottom plate of the 
cell which is 200 thick. The detection of the particle position z t is done using a He-Ne laser and an interferometric 
technique 50]. This technique allows us to have a resolution on the position of the particle of 10~ n m. In order 
to apply a shear to the trapped particle, the cell is moved with a feedback-controlled piezo actuator which insures a 
perfect linearity of displacement [5l| . 

The potential is harmonic: V = kz 2 /2. The stiffness of the potential is k — 9.62 10 -6 kg s -2 . The relaxation time 
is Tj? = a/k = 3.05 10~ 3 s, which has been determined by measuring the decay rate of the autocorrelation of z t . The 
variable zt is acquired at the sampling frequency / = 8192 Hz. The temperature is T — 298 K. 

The mean square displacement of the Brownian particle in the optical trap is a = y/k B T/k = 20.7 nm, while the 
diffusion coefficient is D = a 2 /tr — 1.4 x 10~ 13 m 2 /s. We notice that the relaxation time is longer than the sampling 
time since their ratio is /tr = 25. 




time (s) z (nm) 



FIG. 1: (a) The time series of a typical path zt for the trapped Brownian particle in the fluid moving at the speed u for the 
forward process (upper curve) and —u for the reversed process (lower curve) with u = 4.24 x 10 -6 m/s. (b) Gaussian probability 
distributions of the forward and backward experiments. The mean value is located at ±utr = ±12.9 nm. 

In order to test experimentally that entropy production is related to the time asymmetry of dynamical randomness 
according to Eq. (|30p . time series have been recorded for several values of For each value, a pair of time series is 
generated, one corresponding to the forward process and the other to the reversed process, having first discarded the 
transient evolution. The time series contain up to 2 x 10 7 points each. Figure [1^ depicts examples of paths z t for the 
trapped Brownian particle in the moving fluid. Figure [T}d shows the corresponding stationary distributions for the 
two time series. They are Gaussian distributions shifted according to Eq. (g]). 

The analysis of these time series is performed by calculating the block entropy (f2TJ)) versus the path duration nr, 
and this for different values of e. Figure [2^i shows that the block entropy increases linearly with the path duration nr 
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0.001 0.002 0.003 0.004 

nx (s) 

FIG. 2: (a) The block entropy (or mean pattern entropy) as a function of time nr for the trapped Brownian particle in the fluid 
moving at the speed u — 4.24 x 10 -6 m/s. The time interval r is equal to the sampling time r = 1/f — 1/8192 s. The different 
curves correspond to different values of e = k x 0.558 nm with k = 1, . . . , 20 given in the right-hand column. The distance used 
in this calculation is defined by taking the maximum among the distances \Z(t) — Z m (t)\ for the times t = 0, r, . . . , (n — l)r. 
The larger slopes correspond to the smaller value of e. The linear growth persists up to a maximal value of the mean pattern 
entropy given by the total length of the time series: # max = ln(1.4 x 10 7 ). (b) The mean reversed block entropy as a function 
of time corresponding to (a). After a linear growth, _ff R saturates and falls down to zero (not shown) because of the finiteness 
of the time series which limits the statistics, (c) Differences between the backward and forward (e, r) dynamical entropies in 
(b) and (a) for e between 5.6-11.2 nm for the Brownian particle. Straight lines are fitted to the first part of the curves and 
their slopes give the entropy production according to Eq. (|30|) . 
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\u\ (um/s) 

FIG. 3: Entropy production of the Brownian particle versus the driving speed u. The solid line is the well-known rate of 
dissipation given by Eq. (|9}. The dots depict the results of Eq. (|30[) calculated with the differences between the (e, r)-entropies 
per unit time. The equilibrium state is at zero speed u = where the entropy production vanishes. 




5 (m) 5 (m) 

FIG. 4: (a) (e, r)-entropy per unit time of the Brownian particle scaled by the time interval r as a function of 8 = 
e/y/l — exp( — 2t/tr), for different values of the time interval r = 1//, 2//, 4//, 8//, with the sampling time 1// = 1/8192 s. 
The dots are the results of the computation from the time series for the speed u = 4.24 x 10~ 6 m/s. The solid line depicts the 
expected behavior according to Eqs. ((27} and (|30[1 . (b) Scaled reversed and direct (e, r)-entropies per unit time for r = 4//. 
The solid line is the result expected from Eq. (|30[1 . 

up to a maximum value fixed by the total length of the time series. The time interval is taken equal to the sampling 
time: t = 1//. The forward entropy per unit time h(e,r) is thus evaluated from the linear growth of the block 
entropy (f2T))) with the time nr. 

Similarly, the time-reversed block entropy (|23[) is computed using the same reference sequences as for the forward 
block entropy, reversing each one of them, and getting their probability of occurrence in the backward time series. 
The resulting time-reversed block entropy is depicted in Fig. [2]d versus nr for different values of e. Here also, we 
observe that -ff R grows linearly with the time nr up to some maximum value due to the lack of statistics over long 
sequences because the time series is limited. Nevertheless, the linear growth is sufficiently extended that the backward 
entropy per unit time /i r (e,t) can be obtained from the slopes in Fig. [2)3. 

Figure depicts the difference between the backward and forward block entropies H K and H versus the time 
nr, showing the time asymmetry due to the nonequilibrium constraint. We notice that the differences H R — H are 
small compared with the block entropies themselves, meaning that dynamical randomness is large although the time 
asymmetry is small. Accordingly, the values R — H are more affected by the experimental limitations than the block 
entropies themselves. In particular, the saturation due to the total length of the time series affects the linearity of 
H K — H versus nr. However, we observe the expected independence of the differences H R — H on e. Indeed, the 
slope which can be obtained from the differences H R — H versus nr cluster around a common value (contrary to what 
happens for H and H R ). According to Eq. ([30)) , the slope of if R — H versus nr gives the thermodynamic entropy 
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FIG. 5: Measure of the heat dissipated by the Brownian particle along two randomly selected trajectories in the time series 
of Fig. [1] The fluid speeds are ±w with u = 4.24 x 10~ 6 m/s. (a)-(b) Inset: The two randomly selected trajectories. The 
conditional probabilities P+ and P- of the corresponding forward (filled circles) and the backward (open circles) paths for 
e = 8.4 nm, as evaluated by Eqs. (|31[) an d (|32|l . These probabilities present an exponential decrease modulated by the 
fluctuations. At time zero, the conditional probabilities are not defined and, instead, we plotted at this time the stationary 
probabilities for indication, (c)-(d) The dissipated heat given by the logarithm of the ratio of the forward and backward 
probabilities according to Eq. (|14[) for different values of e = k x 0.558 nm with k = 12, . . . , 19 in the range 6.7-10.6 nm. They 
are compared with the values (squares) directly calculated from Eq. (0. For small values of e, the agreement is quite good for 
short time and are within experimental errors for larger time. 

production. 

This prediction is indeed verified. Figure [3] compares the difference /i R (e,r) — h(e,r) with the thermodynamic 
entropy production given by the rate of dissipation Q as a function of the speed u of the fluid. We see the good 
agreement between both, which is the experimental evidence that the thermodynamic entropy production is indeed 
related to the time asymmetry of dynamical randomness. As expected, the entropy production vanishes at equilibrium 
where u — 0. 

The dynamical randomness of the Langevin stochastic process can be further analyzed by plotting the scaled entropy 
per unit time rh(e, r) versus the scaled resolution 8 = ej — exp(— 2t/tr) for different values of the time interval r, 
as depicted in Fig. [4^. According to Eq. (|27|) . the scaled entropy per unit time should behave as rh(e, r) ~ ln(l/5)+C 
with some constant C in the limit 8 — > 0. Indeed, we verify in Fig. [4^ that, in the limit 8 — > 0, the scaled curves only 
depend on the variable 8 with the expected dependence ln(l/<5). For large values of 8, the experimental curves deviate 
from the logarithmic approximation P7|) , since this latter is only valid for 8 — ► 0. The calculation in Appendix [B] 
shows that we should expect corrections in powers of e 2 to be added to the approximation as ln(l/<5). 

In Fig. [Dd, we depict the scaled direct and reversed (e, r)-entropies per unit time. We compare the behavior of 
h R with the behavior rh R ~ r (h, + fcg d\S/di) expected from the formula (f30|) . This figure shows that the direct 
and reversed (e, r)-entropies per unit time are quantities which are large with respect to their difference due to the 
nonequilibrium constraint. This means that the positive entropy production is a small effect on the top of a substantial 
dynamical randomness. 

Maxwell's demon vividly illustrates the paradox that the dissipated heat is always positive at the macroscopic 
level although it may take both signs if considered at the microscopic level of individual stochastic trajectories. The 
resolution of Maxwell's paradox can be remarkably demonstrated with the experimental data. Indeed, the heat 
dissipated along an individual trajectories is given by Eq. ([7]) and can be obtained by searching for recurrences in the 
time series according to Eq. (fF4"|) . The conditional probabilities entering Eq. 1X4")) are evaluated in terms of the joint 
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probabilities (fT9]l and (f22|) according to 

P + (Z;e,T,n\Z ) = P + (Z;e,T,n)/P + (Z ;e,r,l) (31) 

P_(Z R ;e,r,n|Z n _i) - P_(Z a ;e,r,n)/P_(Z n _ 1 ;e,T,l) (32) 

where we notice that the probabilities with n = 1 are approximately equal to the corresponding stationary probability 
density (j4|) multiplied by the range dz = 2s. The heat dissipated along two randomly selected paths are plotted in 
Fig. [5l We see the very good agreement between the values computed with Eq. using each path and Eq. (fl4|) 
using the probabilities of recurrences in the time series. We observe that, at the level of individual trajectories, the 
heat exchanged between the particle and the surrounding fluid can be positive or negative because of the molecular 
fluctuations. It is only by averaging over the forward process that the dissipated heat takes the positive value depicted 
in Fig. [3] Indeed, Fig. [3] is obtained after averaging over many reference paths as those of Fig. [5j The positivity of 
the thermodynamic entropy production results from this averaging, which solves Maxwell's paradox. 

V. ELECTRIC NOISE IN RC CIRCUITS 

The second system we have investigated is an RC electric circuit driven out of equilibrium by a current source 
which imposes the mean current I [l7| . The current fluctuates in the resistor because of the intrinsic Nyquist thermal 
noise [16fl . The RC electric circuit and the dragged Brownian particle, although physically different, are known to be 
formally equivalent by the correspondence given in Table HI 

The electric circuit is composed of a capacitor with capacitance C = 278 pF in parallel with a resistor of resistance 
R = 9.22 Mfl. The relaxation time of the circuit is tr = RC — 2.56 x 1CP 3 s. The charge q t going through the 
resistor during the time interval t is acquired at the sampling frequency / = 8192 Hz. The temperature is here also 
equal to T = 298 K. 

The mean square charge of the Nyquist thermal fluctuations is a = y/k B TC = 6.7 x 10 3 e where e = 1.602 x 1CT 19 
C is the electron charge. The diffusion coefficient is D = a 2 /tr — 1.75 x 10 10 e 2 /s. The ratio of the relaxation time 
to the sampling time is here equal to /tr = 21. 

As for the first system, pairs of time series for opposite drivings ±7 are recorded. Their length are 2 x 10 7 points 
each. Figure [5] depicts an example of a pair of such paths with the corresponding probability distribution of the charge 
fluctuations. 




time (s) 1,-" (C) 



FIG. 6: (a) The time series of a typical path qt — It for the Nyquist noise in the RC electric circuit driven by the current I 
(upper curve) and opposite current —I (lower curve) with I = 1.67 x 10 -13 A. (b) Gaussian probability distributions of the 
forward and backward experiments. The unit of the electric charge q t — It is the Coulomb (C). 

The block entropies are here also calculated using Eqs. (|20[) and (|23|) and the (e, r)-entropies per unit time are 
obtained from their linear growth as a function of the time nr. The scaled entropies per unit time rh are depicted 
versus 8 in Fig. [7^,. Here again, the scaled entropy per unit time is verified to depend only on 8 for 8 — > 0, as expected 
from the analytical calculation in Appendix [B] In Fig. [7|d, we compare the scaled reversed (e, r)-entropy per unit 
time to the behavior rh R ~ r (h + fcg 1 diS '/ dt) , expected by our central result ([30|) . 

The difference between the time-reversed and direct (e, r)-entropies per unit time is then compared with the 
dissipation rate expected with Joule's law. We observe the nice agreement between both in Fig. [SJ which confirms 
the validity of Eq. ([30]) . Here also, we observe that the entropy production vanishes with the current at equilibrium. 

VI. DISCUSSION 

In this section, we discuss about the comparison between the present results and other nonequilibrium relations. 
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5 (C) 5 (C) 

FIG. 7: (a) (e, r)-entropy per unit time of the RC electric circuit scaled by the time interval r as a function of S = 
e/ — exp( — 2t/tr), for different values of the time interval r = 1//, 2//, 4//, 8//, with the sampling time 1/f — 1/8192 s. 
The dots are the results of the computation from the time series for the current / = 1.67 x 1CF 13 A. The solid line depicts the 
expected behavior according to Eqs. (|27p and (|30|l . (b) Scaled reversed and direct (e, r)-entropies per unit time for r = 4//. 
The solid line is the result expected from Eq. (|30[1 . The unit of 8 is the Coulomb (C). 
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FIG. 8: Entropy production of the RC electric circuit versus the injected current I. The solid line is the Joule law, TdiS/dt = 
RI 2 . The dots are the results of Eq. (130[l . The equilibrium state is at zero current, I — 0, where the entropy production is 
observed to vanish. 



The relation (|30p expresses the entropy production as the difference between the backward and forward (e, r)- 
entropies per unit time. The backward process is obtained by reversing the driving constraints, which is also a 
characteristic feature of Crooks relation [25j |. However, Crooks relation is concerned with systems driven by time- 
dependent external controls starting at equilibrium. In constrast, our results apply to nonequilibrium steady states. 
Another point is that Crooks relation deals with the fluctuations of the work performed on the system, while the 
present relation (|30[) gives the mean value of the entropy production and, this, in terms of path probabilities. In 
this respect, the relation (|30|) is closer to a formula recently obtained for the mean value of the dissipated work in 
systems driven out of equilibrium by time-dependent external controls [291 ]. This formula relates the mean value of 
the dissipated work to the logarithm of the ratio between two phase-space probability densities associated with the 
forward and backward processes, respectively. These phase-space probability densities could in principle be expressed 
as path probabilities. Nevertheless, these latter would be defined for systems driven over a finite time interval starting 
from the equilibrium state, although the present equation (|30[) applies to nonequilibrium steady states reached in the 
long-time limit. 

We now compare our results to the extended fluctuation theorem, which concerns nonequilibrium steady states [l5l . 
IT5, • The extended fluctuation theorem is a symmetry relation of the large-deviation properties of the fluctuating 
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heat dissipation Q during a time interval t. The probability that this fluctuating quantity takes the value 

c=4f (33) 

decays exponentially with the rate 

1 r o, ~) 

(34) 



G(0 = lira -\ In Pr \t < ^ < C + ^} 



This rate is a function of the value £. Since the variable £ can significantly deviate from the statistical average for 
some large fluctuations, the rate ([34"]) is called a large-deviation function. The extended fluctuation theorem states 
that the ratio of the probability of a positive fluctuation to the probability of a negative one increases exponent ially 
as exp(£i) in the long-time limit t — > oo and over a range of values of £, which is limited by its average (Q |15l Il6l. fl7f. 
Taking the logarithm of the ratio and the long-time limit, the extended fluctuation theorem can therefore be expressed 
as the following symmetry relation for the decay rate (|34[) : 



( = k B [G(-() - G(0\ for -(C)<C<(0 (35) 

In this form, we notice the analogy with Eq. (|30p . A priori, the decay rate ()34|) can be compared with the (e, r)- 
cntropy per unit time, which is also a decay rate. However, the decay rate (|34[) concerns the probability of all the paths 
with dissipation £ while the (e, r)-entropy per unit time concerns the probability of the paths within a distance e of 
some reference typical paths. The (e, r)-entropy per unit time is therefore probing more deeply into the fluctuations 
down to the microscopic dynamics. In principle, this latter should be reached by zooming to the limit e — > 0. 

A closer comparison can be performed by considering the mean value of the fluctuating quantity Q which gives the 
thermodynamic entropy production: 

l{Q t ) diS 

C = lim --=- = — 36) 

t-»oo t 1 at 

Since the decay rate (j34|) vanishes at the mean value: 

G«C» = (37) 

we obtain the formula 

(C) - k B G{ - (0) (38) 

which can be quantitatively compared with Eq. (|30[) since both give the thermodynamic entropy production. Although 
the time-reversed entropy per unit time /i R (e,r) is a priori comparable with the decay rate G(— £), it turns out that 
they are different and satisfy in general the inequality h R (e, r) > G(— (£)) since the entropy per unit time is always non 
negative h(e,r) > 0. Moreover, h(e,r) is typically a large positive quantity. The greater the dynamical randomness, 
the larger the entropy per unit time h(e, r), as expected in the limit where e goes to zero. This shows that the 
(e, r)-entropy per unit time probes finer scales in the path space where the time asymmetry is tested. 



VII. CONCLUSIONS 



We have here presented detailed experimental results giving evidence that the thermodynamic entropy production 
finds its orgin in the time asymmetry of dynamical randomness in the nonequilibrium fluctuations of two experimental 
systems. The first is a Brownian particle trapped by an optical tweezer in a fluid moving at constant speed < \u\ < 
4.3 fim/s. The second is the electric noise in an RC circuit driven by a constant source of current < |/| < 0.3 pA. 
In both systems, long time series are recorded, allowing us to carry out the statistical analysis of their properties of 
dynamical randomness. 

The dynamical randomness of the fluctuations is characterized in terms of (e, r)-entropies per unit time, one for the 
forward process and the other for the reversed process with opposite driving. These entropies per unit time measure 
the temporal disorder in the time series. The fact that the stochastic processes is continuous implies that the entropies 
per unit time depend on the resolution e and the sampling time r. The temporal disorder of the forward process is 
thus characterized by the entropy per unit time h(e, r), which is the mean decay rate of the path probabilities. On 
the other hand, the time asymmetry of the process can be tested by evaluating the amount of time-reversed paths of 
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the forward process among the paths of the reversed process. This amount is evaluated by the probabilities of the 
time-reversed forward paths in the reversed process and its mean decay rate, which defines the time-reversed entropy 
per unit time h R (e,r). The time asymmetry in the process can be measured by the difference /i R (e,r) — h(e,r). 
At equilibrium where detailed balance holds, we expect that the probability distribution ruling the time evolution is 
symmetric under time reversal so that this difference should vanish. In contrast, out of equilibrium, detailed balance 
is no longer satisfied and we expect that the breaking of the time-reversal symmetry for the invariant probability 
distribution of the nonequilibrium steady state. In this case, a non-vanishing difference is expected. 

The analysis of the experimental data shows that the difference of (e, r)-entropies per unit time is indeed non 
vanishing. Moreover, we have the remarkable result that the difference gives the thermodynamic entropy production. 
The agreement between the difference and the thermodynamic entropy production is obtained for the driven Brow- 
nian motion up to an entropy production of nearly 120fcBT/s. For electric noise in the RC circuit, the agreement 
is obtained up to an entropy production of nearly 200fcBT/s. These results provide strong evidence that the ther- 
modynamic entropy production arises from the breaking of time-reversal symmetry of the dynamical randomness in 
out-of-equilibrium systems. 
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francaise de Belgique" (contract "Actions de Recherche Concertees" No. 04/09-312), and by the French contract 
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APPENDIX A: PATH PROBABILITIES AND DISSIPATED HEAT 



The detailed derivation of Eq. (fl4)) is here presented for the case of the Langevin stochastic process ruled by 
Eq. fl}. This stochastic process is Markovian and described by a Green function G(z, Zo;t) which is the conditional 
probability that the particle moves to the position z during the time interval t given that its initial position was Zq 
15211. For small values r of the time interval, this Green function reads 



G(z,z ;t) 



fta 
Attt 



exp 



Pa 
47 



Z - ZQ - T 



\ a 



-i 2 



If we discretize the time axis into small time intervals r, the path probability (|12p becomes 



(Al) 



P[z t \z } oc G(z i} Zi-i;r) 



(A2) 



with (n — l)r = t. The ratio (|14[) of the direct and reversed path probabilities is thus given by 



P+[zt\z ] 



n 



G + (z u Zi^i;T) 



P-[z?\z$] f \ G_(z„_ t _i,z n _, ; ;r) 
where the subscript is the sign of the fluid speed u. Inserting the expression (|A1|) for the Green functions, we get 



(A3) 
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(A4) 



where we used the substitution n — i — > i in the last terms of each sum. In the continuous limit n — > oo, r — > with 
(n — l)r = t, the sums become integrals and we find 



hi 



F(z)dz~u / F(z t ,)dt' 



V{z )-V{z t )-u / F{z t ,)dt' 



(A5) 
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since F(z) = —d z V(z). We thus obtain the expression given in Eq. (| 14|) . 
Now, we show that the detailed balance condition 

equilibrium: P+ [z t ] = P_ [zf] (u = 0) (A6) 

holds in the equilibrium state when the speed of the fluid is set to zero. Indeed, the equilibrium probability density 
of a Brownian particle in a potential V(z) is given by 

Pcq (z) = C exp [-pV{z)\ (A7) 

with a normalization constant C. Since the joint probabilities are related to the conditional ones by Eq. (|13p with 
p s t = p eq at equilibrium, we find 



In- 



P+[Zt] =1 P+[zt\z }Pcq(zo) 



P.[zf] e q P_[^|^] Peq (^) 



cq 



= (A8) 



The vanishing occurs at zero speed u = as a consequence of Eqs. (|A5|) . (|A7[) . and z^ = z t . Hence, the detailed 
balance condition is satisfied at equilibrium. Therefore, the last expression of Eq. (|15j) vanishes at equilibrium with 
the entropy production, as expected. 



APPENDIX B: DYNAMICAL RANDOMNESS OF THE LANGEVIN STOCHASTIC PROCESS 



In this appendix, we evaluate the (e, r)-entropy per unit time of the Grassberger-Procaccia algorithm for the 
Langevin stochastic process of Eq. ([T|) with a harmonic trap potential. In this case, the Langevin process is an 
Ornstcin-Uhlcnbeck stochastic process for the new variable 



y = z- ut r 



The Langevin equation of this process is 



dt 



y_ 6 

tr a 



(Bl) 



(B2) 



The probability density that the continuous random variable Y(t) takes the values y = (yo, yi, y n -i) a t the 
successive times 0, r, 2r, (n — l)r factorizes since the random process is Markovian: 



with the Green function 



with the variance 



p(yo, -,Vn-i) = G(y„_i,y„_ 2 ;r) • • • G(y u y Q \T) p st (yo) 
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The stationary probability density is given by the Gaussian distribution 

1 



Pst(y) = hm G(y,y ;t) 

t — >oo 



, exp . , 
V 2a 2 



(B3) 
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Denoting by y T the transpose of the vector y, the joint probability density (|B3|) can be written as the multivariate 
Gaussian distribution 



exp^lyT.C^-y) 

(27r)t(det C n )i 



(B7) 
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in terms of the correlation matrix 
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and its determinant by 

det C n = a 2n (l-r 2 ) n - 1 
The (e, r)-entropy per unit time is defined by 

r*+oo 



(Bll) 



h(e,T)= lira — — / dj/o • • • / 



+oc /■+£ 



d-Vn-i p(yo + Va, -,y n -i + Vn-i) 



(B12) 

where {yj = yj+Vj}^=o represents the tube of trajectories satisfying the conditions \y'j — Uj\ < £ with j = 0, 1, ...,n— 1, 
around the reference trajectory sampled at the successive positions {yj}™Zo ■ After expanding in powers of the variables 
rjj and evaluating the integrals over — e < rjj < +e, the logarithm is obtained as 



In j di] ■ 



dr) n -i p(y + r/o, ...,y n -i + Vn-i) = In 



To ;i - \y T ■ c n 1 • y + o( £ 2 ) (bis) 

(27r) 2 (det C„) 2 ^ 



The integrals over — oo < y,- < +oo can now be calculated to get the result (f2"T)) by using Eq. (|B11|) . We find 



h(e,T) = -\n ] l — (l-r 2 ) + 0(e 2 ) 



(B14) 



Since the relaxation time is given by Eq. ([5]) and the diffusion coefficient by Eq. (|28|) . the variance of the fluctuations 
can be rewritten as a 2 = k^T/k = Dtr. Substituting in Eq. (|B14j) . we obtain the (e, r)-entropy per unit time given 
by Eq. |27[) . The above calculation shows that the (e, r)-entropy per unit time of the Ornstein-Uhlenbeck process is 
of the form 



T V 6 



(B15) 



with some function 4>(s, r) of s = Dtji/e 2 — a 2 je 2 and r = exp(— t/tr). 

In the limit where the time interval r is much smaller than the relaxation time tr, the only dimcnsionless variable 
is the combination Dt/e 2 . In this case, we recover the result that the (e, r)-entropy per unit time is given by 



h{e,T) = -ip 

T 



for t -C t r 



(B16) 
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This fe, r)-entropy per unit time is characteristic of pure diffusion without trap potential, as previously shown 0, l4rl 
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